Method, system and apparatus of recording and playing back an experience in a virtual worlds system

ABSTRACT

A recorded experience in a virtual worlds system may be played back by one or more servers instantiating a new instance of a scene using one or more processors of the one or more servers and playing back the recorded experience in the new instance by modeling objects of a recorded initial scene state of the recorded experience in the new instance and updating the recorded initial scene state based on subsequent recorded changes over a time period, a recorded experience file includes the recorded initial scene state and the subsequent recorded changes and is stored in one or more memories of the one or more servers. One or more client devices are in communication with the one or more servers to participate in the new instance.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to and is a continuation of U.S. Pat.Application Serial No. 16/525,440, filed on Jul. 29, 2019, which is acontinuation of U.S. Pat. Application Serial No. 15/670,926, filed onAug. 7, 2017, which is a continuation of U.S. Pat. Application SerialNo. 14/457,828, filed on Aug. 12, 2014 (now U.S. Pat. No. 9,724,605,issued Aug. 8, 2017), which applications are hereby incorporated byreference in their entireties. This application is related to thefollowing application: PCT Application Serial No. PCT/CA2015/050745,filed Aug. 6, 2015, which is incorporated herein by reference in itsentirety.

FIELD OF INVENTION

The present disclosure relates to virtual computer-generatedenvironments through which users are able to navigate.

DESCRIPTION OF THE BACKGROUND

Computer generated virtual environments are increasingly popular methodsfor people, both real and automated, to interact within a networkedsystem. Various on-line environments are known in which athree-dimensional, 2.5-dimensional or two-dimensional physical world(actual or fantasy) is simulated. Environments of this type aresometimes referred to as “virtual reality” or “virtual reality universe”(VRU) environments. In known VRU environments, an actual or fantasyuniverse is simulated within a computer memory. Multiple players mayparticipate in the environment through a computer network, such as alocal area network or a wide area network. Each player is typicallyrepresented by an “avatar,” which may comprise a figure of a man, woman,or other being, to represent them in the VRU environment. Players sendinputs to a VRU engine to move their avatars around the VRU environment,and are able to cause interaction between their avatars and objects inthe VRU. For example, a player’s avatar may interact with an automatedentity or person, simulated static objects, or avatars operated by otherplayers.

It is possible to record a state of a VRU environment so that users maylog out of the VRU and, upon their return, resume an activity at thepoint where they left off. For example, when playing chess, users maytake a break and return to the same chess board at a later time.

It may be desirable to replay a scene that occurred in a VRUenvironment, such as a concert, a wedding or a lecture, for example.

SUMMARY OF THE INVENTION

In an aspect of the present disclosure, there is provided, a method ofplaying back a recorded experience in a virtual worlds system,comprising : instantiating, using one or more processors of a server, anew instance of a scene, the new instance being defined by data storedin memory, at least one client device displaying and participating inthe new instance; retrieving a recorded experience file from the memory,the recorded experience file having been generated by saving an initialscene state and saving subsequent changes and respective times during atime period of the recorded experience; and playing back the recordedexperience file by rendering, for display by the at least one clientdevice, objects of the initial scene state in the new instance andrendering updates to the initial scene state based on the subsequentchanges over the time period.

In another aspect of the present disclosure, there is provided a virtualworlds system for playing back a recorded experience, comprising : oneor more servers instantiating a new instance of a scene using one ormore processors of the one or more servers and playing back a recordedexperience in the new instance by rendering objects of a recordedinitial scene state of the recorded experience in the new instance andrendering updates to the recorded initial scene state based onsubsequent recorded changes over a time period, one or more recordedexperience files comprising the recorded initial scene state and thesubsequent recorded changes being stored in memory of the one or moreservers; and one or more client devices in communication with the one ormore servers, the one or more client devices participating in the newinstance. In another aspect of the present disclosure, there is providedan apparatus for playing back a recorded experience in a virtual worldssystem, comprising : one or more processors of a server system forinstantiating a new instance of a scene and for communicating with oneor more client devices participating in the new instance; memory of theserver for storing one or more recorded experience files, the one ormore recorded experience files having been generated by saving aninitial scene state and saving subsequent changes and respective timesduring a time period of the recorded experience; wherein the processorplays back the recorded experience file in the new instance by renderingobjects of the initial scene state in the new instance and renderingupdates to the initial scene state based on the subsequent changes overthe time period.

Other aspects and features of the present disclosure will becomeapparent to those ordinarily skilled in the art upon review of thefollowing description of specific embodiments in conjunction with theaccompanying figures.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present application will now be described, by way ofexample only, with reference to the attached Figures, wherein:

FIG. 1 is a block diagram of an example computer network systemconnecting virtual worlds service providers and users;

FIG. 2 is a diagram showing an example arrangement of virtual worldsdata on a service provider, as used in an embodiment;

FIG. 3 is an example screen shot of a user interface in which a recordedexperience is being played back;

FIG. 4 is a schematic diagram showing example screen shots of a userinterface in which a recorded experience is being played back over atime period;

FIG. 5 is a method of recording a scene according to an embodiment;

FIG. 6 is a method of playing a recorded experience, according to anembodiment;

FIG. 7 is another example screen shot of a user interface in which arecorded experience is being played back;

FIG. 8 is another method of playing a recorded experience, according toan embodiment; and

FIG. 9 is another example screen shot of a user interface in which arecorded experience is being played back.

DETAILED DESCRIPTION

It will be appreciated that for simplicity and clarity of illustration,where considered appropriate, reference numerals may be repeated amongthe figures to indicate corresponding or analogous elements. Inaddition, numerous specific details are set forth in order to provide athorough understanding of the embodiments described herein. However, itwill be understood by those of ordinary skill in the art that theembodiments described herein may be practiced without these specificdetails. In other instances, well-known methods, procedures andcomponents have not been described in detail so as not to obscure theembodiments described herein. Also, the description is not to beconsidered as limiting the scope of the embodiments described herein.

Referring to FIG. 1 , a computer network system 100 connects virtualworld service providers 102 with users 104 via a network 106. Thecomputer network system 100 is capable of rendering a VRU environmentand managing changes to the VRU environment resulting from userparticipation in the VRU environment. Examples of virtual worldssoftware usable to render and participate in virtual worlds includeCurio™ by The Virtual World Web Inc. and Second Life™.

Service providers 102 include computing devices and systems offeringvirtual worlds services. Service providers 102 may include computinghardware and/or software configured to perform one or more of theprocesses described herein. In an embodiment, multiple service providers102 may be housed on a single computing device. Service providers 102may also be distributed across multiple devices, as in cloud computingor distributed systems.

In an embodiment, which is depicted in FIG. 1 , each service provider102 is hosted on a server 106 that includes a processor 108 and a memory110. According to another embodiment, in order to use the computationalability of the computer network system 100 as a whole, some functions ofthe server(s) may be provided by the users. This distributed computingstructure may allow for more powerful computational abilities, as thefull computer power of all users may be utilized to provide some or allserver functions to the network. In this embodiment, some or all of theusers may function as both clients and servers. Service providers 102communicate via one or more networks 106 with users 104. The networks106 may include, for example, Internet networks, cellular networks,local area networks, wide area networks, wireless networks, Ethernetnetworks, and so on, as well as combinations thereof. Users 104 mayinclude user computing devices, such as desktop computers, laptopcomputers, mobile computing devices, mobile phones and tablets, forexample. The term “user” throughout this specification may be used torefer to a user device such as the aforementioned and/or an entity, suchas an individual, operating such a device, as appropriate to the contextof the term. In an embodiment, users 104 operate.

Additional devices and systems may be included in the system of FIG. 1 .For example, service providers 102 may communicate with common datastores, such as account databases, registration or authenticationservers and management servers, for example. Such use of centralizedsystems may allow service providers 102 to easily synchronize andcoordinate among each other, for example, to coordinate avatar locationtransitions, to synchronize user accounts, and so on.

FIG. 2 shows an example arrangement of virtual worlds data, as used inan embodiment. The blocks represent types of data objects, andinterconnections may represent relationships among the data elements,such as pointers, references, subclass relationships, or the like. Datastructures may be stored on computer-readable media of the server system102, for example, such as a hard drive, SSD, tape backup, distributedstorage, cloud storage, and so on, and may be structured as relationaldatabase tables, flat files, C structures, programming language objects,database objects, and the like. In various embodiments, additionalelements may be included, some elements may be removed, and/or elementsmay be arranged differently from what is shown. Service provider 102 maybe represented as a data object with general data relating to theservice provider. The service provider 102 may maintain accounts 200 forusers of the service provider. The account objects 200 may includerelevant data relating to users, such as usernames, authenticationinformation, attribute information, personal information, and so on.Each account may further be associated with one or more avatars 202,which the user may select for appearing in a virtual world. The serviceprovider 102 may allow users to maintain multiple avatars, may restrictusers to a single avatar or may allow users to navigate through a VRU asobservers with no avatar, in various embodiments. When allowing users104 to maintain multiple avatars, a service provider 102 may allow usersto take on different appearances and personas in different situations,as selected by the users 104 and/or the service provider 102.

The service provider 102 may further maintain worlds 204. Each world 204may represent a virtual space in which avatars may interact. The serviceprovider 102 may maintain multiple virtual worlds 204, and each virtualworld 204 may be operated by different users 104 or administrators ofservice provider 102.

Virtual worlds 204 may in turn include scenes 206. Scenes 206 representvirtual locations where users may visit and enter. A scene 206 may bedefined by various attributes such as appearance, size, furniture,included items, architecture and so on. Scripts may also be included aspart of the scene 206. Scripts are generally software based instructionsthat, when executed, result in changes to the scene 206. Scripts may beexecuted in response to user actions, may be executed at specifiedtimes, or may be executed in response to trigger events. For example,curtains covering a stage may be opened in response to an avatar pullinga cord, may be opened when a concert start time is reached or may beopened when the capacity of the concert venue reaches a predeterminedsize.

In some situations, it may be desirable to have a single scene 200available but have avatars enter different copies of that scene. Suchcopies are implemented by instances 208. An instance 208 represents arunning version of a scene, and users 104 interact within instances 208of scenes 206. In an embodiment, the computer network system 100includes one or more servers in communication with the service providers102 to operate as instance hosts that run the instances 208. The serviceprovider 102 may use rules specified for a particular scene 206 in orderto determine when to create a new instance. For example, one may createa scene arranged to appear like a virtual tennis court, and it may bedesirable for pairs of tennis players to be provided distinct copies ofthe scene rather than making all players use the same virtual space. So,a new instance would be initiated each time a pair of tennis playersenters the virtual tennis court and instances that are currently runninghave reached capacity.

New instances may also be created based on time intervals, avatar userrequests, availability of objects within each instance, and so on. Inone embodiment, an environment may automatically change, or the avatarsmay be automatically transported, when a threshold event takes place.For example, avatars waiting to play poker may be automaticallytransported to the poker room when eight avatars have signed up for thetable. In another example, a prospective tennis player may wait in awaiting room until another tennis player arrives and the waiting room istransformed into a tennis court.

Instances may originally be configured based on the specification of theunderlying scene. For example, a newly created instance may be arrangedto have the same contained items, the same appearance, the same size,the same scripts and so on, with respect to the scene. In alternateembodiments, the scene may include instructions that randomize orotherwise alter the nature of each new instance. As users interact withan instance of a scene, those avatars may cause changes to the containeditems, appearance, and so on.

Such changes may or may not be reflected back to the original scene, toother copies of the scene or other instances of the scene, possiblydepending on the configuration of the scene. Additionally, in anembodiment, new instances may be based on existing instances, ratherthan being based on the original scenes.

Within a service provider, worlds 204, scenes 206, and instances 208 maybe represented as data structure objects, such as document objects, forexample. The document objects are encoded in a descriptive language anddefine respective 3-D, 2.5-D or 2-D modeled objects or spaces. Serviceproviders may include software modules to convert these objects tographical or other representations. The software may be operated on theservice provider to generate those representations. Additionally oralternately, client software operating on user devices may perform thetranslation of data structure objects to graphical representations.

In order for one or more users to interact in a virtual world, thesystem 100 instantiates, in memory, an instance of a scene defined by acollection of document objects. The service provider 102, or anothersystem component, controls contents of the collection of documentobjects in response to signals received at one or more processors fromone or more client devices of the users 104. The service provider 102,or another system component, receives, at one or more processors, datarequesting changes to an instance of a scene including at least positionand orientation of objects modeled in the scene. Data representing thechanges is then provided to the one or more users so that an eventplaying out in an instance of a scene may be experienced insubstantially real time by users 104.

Referring to FIG. 3 , an example of a scene 300 that has beeninstantiated by the service provider 102 is shown. In this example, thescene 300 is a performance venue including a floor 306 and walls 308 anda piano 302 located on a stage 304 that is rendered for display at auser 104. Also rendered for display are: a performer avatar 310 islocated on the stage 304 and an audience that includes avatars 312 thatsurround the stage to view the performance.

FIG. 4 schematically shows the scene 300 as it changes over time from aninitial state 400 at the beginning of a time period, to an intermediatestate 402 and to a final state 404 at the end of the time period. Asshown, an elapsed time at which each scene state occurs, measured fromthe initial state, is indicated on timeline 406. In another embodiment,the changes from the initial state 400 are stored as a series of frames,which are recorded at regular intervals, such as approximately every0.01667 seconds, for example, which results in 60 frames per secondbeing recorded. In one example of this embodiment, the frames arerecorded regardless of whether changes to the scene have occurred.

Any VRU experience, such as the performance depicted in FIGS. 3 and 4 ,for example, may be experienced by users 104 in substantially real timeand may be recorded to be experienced at a later time. A method ofgenerating a recording of a VRU experience is shown in FIG. 5 . Themethod may be carried out by software executed by one or more processorsof the computer network system 100 and stored as computer-readable codein a computer-readable medium. Coding of software for carrying out sucha method is within the scope of a person of ordinary skill in the artgiven the present description.

According to the method, a new scene is first instantiated at 500. Then,the service provider 102, or another component of the system 100, saves,to an initial scene file stored at the one or more memories, an initialscene state, at 502. The initial scene state includes at least aposition and orientation of objects, including avatars, rendered in thescene at a beginning of a time period of a new recording. Changed scenestates result after a change to the initial scene state or to a previouschanged scene state has occurred. Changes to the initial scene state andsubsequent changed scene states, are saved to a recorded experiencefile, at 504. The initial scene state and the changes may be saved asdata structure objects, such as document objects, for example, that areencoded in a descriptive language to define the objects of the scene. Inan embodiment, the initial scene file and the recorded experience fileare the same file.

Every change may be saved along with a time at which the change occurredor only some changes may be saved. In an embodiment, changes may besaved at selected intervals over the time period so that a completerecording may be generated by interpolating between the changes at theselected intervals.

Changes may be saved in response to avatar movements and interactionsbetween objects, for example. Changes may also be saved in response toinitiation of electronic messaging or webcam interactions between users,for example. In this example, a chat interaction or a video interactionmay be captured and stored as a separate file accessible when the savedchanges are played back. In addition, alterations to object appearanceand behavior resulting from plug-in applications, or images or videoinserted into the scene may also be saved as changes or in a separatefile accessible when the saved changes are played back.

The VRU experience may be recorded in its entirety or, alternatively,only selected portions may be recorded. For example, walls of a scenemay not be recorded in order to allow for expansion of a room, forexample, when the recorded experience is played back. Further, avatarsthat are friends of a user may be recorded and avatars that are notknown to a user may not be recorded or a lecturer may be recorded forfuture playback but the audience may not be recorded. Selecting only aportion of an instance of a scene to record has several advantagesincluding: conserving memory, avoiding potential copyright issues andpreserving privacy, for example.

When a recorded experience, which may also be referred to as a videoexperience or vidience™ is played back, a user is able to navigatearound recorded objects, as an observer or as an avatar, as ifnavigating through the original scene. Depending on the contents of therecorded experience file, the user may also see alterations to objectappearance and behavior available from plug-in applications, listen toaudio and view chats, video and images, for example. A method forplaying back the recorded experience is shown in FIG. 6 . The method maybe carried out by software executed by one or more processors of thecomputer network system 100 and stored as computer-readable code in acomputer-readable medium. Coding of software for carrying out such amethod is within the scope of a person of ordinary skill in the artgiven the present description.

According to the method, an instance of a new scene is firstinstantiated, at 600, using one or more processors of the computernetwork system 100. The new instance is defined by data stored inmemory. The new scene may include nothing at all with all objects beingdrawn into the blank space from the recorded experience. Alternatively,the new scene may be include at least some boundaries but be empty ofobjects when instantiated or, optionally, objects of the new scene maybe hidden. The recorded experience file(s) is then retrieved from memoryand played back within the new scene, at 602, by rendering, at theservice provider 102 for display at a client device, objects of theinitial scene state in the new instance and rendering updates to theinitial scene state based on the subsequent changes over the timeperiod.

The objects of the recorded experience are displayed in the new scenesuch that, similar to when the recorded experience was experienced thefirst time, objects and boundaries of the recorded experience arepresent. A user, by controlling an avatar via a user interface at aclient device, may navigate through the recorded experience and interactwith other avatars also participating in the playback of the recordedexperience. As indicated at 602, more than one recorded experience maybe played back at the same time.

In an embodiment, a collection of document objects represents the newscene and the recorded experience file. The service provider 102, oranother system component, controls contents of the collection ofdocument objects in response to communications received at one or moreprocessors from one or more client devices of the users 104. The serviceprovider 102, or another system component, receives data requestingchanges to the instance of the new scene including at least position andorientation of objects in the new scene. Data representing the changesis then provided to the one or more users so that an event playing outin the instance of the new scene may be experienced in substantiallyreal time by users 104. The recorded experience is not modifiable byevents occurring during playback.

In another embodiment, a first collection of document objects representsthe new scene and a second collection of document objects represents therecorded experience. In this embodiment, the new scene and the recordedexperience are layered upon one another by the service provider 102 orat the client device. Any conflicts between the first and secondcollections, such as objects occupying the same location, for example,are resolved at by the service provider 102 or at the client device.Data requesting changes to the instance of the new scene is received bythe service provider 102 and data representing the changes is thenprovided to the one or more users so that an event playing out in theinstance of the new scene may be experienced in substantially real timeby users 104. Similar to the previous embodiment, the recordedexperience is not modifiable by events occurring during playback. Arecorded experience may be replayed in response to a user request to aservice provider 102, may be replayed periodically at selected timeintervals or may be replayed in response to a number of users waiting toparticipate in the recorded experience reaching a threshold. Users mayjoin a new scene at any point during playback of the recordedexperience. In this way, users may join other users at their point inthe playback of the recorded experience. Alternatively users may be ableto instantiate their own new scene and playback the recorded experience.

In an embodiment, in order for users navigating through a recordedexperience to feel as though they are experiencing the original scene,collisions are set to occur when objects such as avatars, for example,of the new scene attempt to occupy the same location as objects, such asavatars, for example, of the recorded experience. In an alternativeembodiment, collisions between objects of the new scene and objects ofthe recorded experience may be turned off. In this way, objects of thenew scene may pass through objects of the recorded experience. This maybe useful when the recorded experience is crowded and the avatars of thenew scene are attempting to move across a room, for example.

In an embodiment, objects including avatars may be marked fornon-recording. The objects may be marked for non-recording in responseto user opt-out instructions or copyright issues, for example. Objectsthat are not recorded may be substituted with another object duringplayback of the recorded experience. In a further embodiment,replacement objects, such as anonymous bot avatars, for example, may besubstituted for non-recorded avatars during playback of the recordedexperience. According to the example, bots may be included to fill emptyseats of avatars that are not recorded, due to opt-out, for example, ata concert or other event. Replacement of the objects that have opted outmay be based on selection or may be automated.

In another embodiment, private messages may be saved. Private messagesmay enhance playback of a recorded experience. For example, privatemessage between a student and an assistant professor during a lecture,may remind the student of additional information obtained during thelecture. Alternatively, the sender and/or the recipient may unmark themessages as private. Private messages may be viewable by all users whena recorded experience is played back or by the sender and recipient ofthe private messages only. In an alternative embodiment, privatemessages may not be saved and instead, metadata may be substituted forprivate messages so that users viewing the recorded experience may bemade aware that private messages were sent but are not able to view thecontents of the private messages.

Also referring to FIG. 7 , a single recorded experience is played backin a new scene 700 and visiting users, represented by avatars 702, areable enter the new scene 700 when the recorded experience is playing andnavigate around the recorded experience. As shown, all of the recordedobjects are present as the visitor avatars 702 move through the newscene 700. As such, the visitor avatars 702 are able to experience thescene as it was experienced by the users who were present during theoriginal scene.

When a new scene is instantiated, the new scene may include nothing atall, may include some boundaries but be empty of objects or may includesome objects. In the example of FIG. 7 , the new scene 700 includes aplant object 704 that was not present in the recorded event. The visitoravatars 702 may move through the scene 700, interact with one another,interact with other objects belonging to the new scene 700 andcommunicate via electronic messages or webcam, for example. Further,when a new scene is instantiated, the new scene may include scripts thatare layered at locations where scripts from the recorded experience wereavailable. This allows the recorded experience to maintain functionalitythat was available in the original scene that was recorded.

Referring to FIG. 8 , according to another embodiment, the new scene, inwhich the recorded experience is being played, may be recorded, asindicated at 800. After the new scene has been recorded and a newrecorded experience file saved, the new recorded experience may beplayed back, as described with respect to FIG. 6 . The new recordedexperience will only include elements from the new scene. Recordedexperiences may be “layered” on top of one another each time an originalscene is re-played. For example, as shown in FIG. 9 , the originalperformance event of scene 300 and the performance event of scene 700are layered and a new scene 900 is instantiated according to the methodof FIG. 7 . Avatars 902 are visitors to the new scene 800 and mayinteract with one another. According to another embodiment, a single newrecorded scene file may be generated that merges the original recordedexperience with one or more subsequent recorded experiences. The methodof FIG. 8 may be carried out by software executed by one or moreprocessors of the computer network system 100 and stored ascomputer-readable code in a computer-readable medium. Coding of softwarefor carrying out such a method is within the scope of a person ofordinary skill in the art given the present description.

In one example, the system and method described herein is used for filmproduction. An environment of a film, such as waves crashing on a beach,may be recorded in a first recorded experience. Extra actors may berecorded in a second recorded experience while the environment scene isplayed back. Finally, main actors may be recorded in a third recordedexperience that is layered on the first recorded experience and secondrecorded experience to provide an animated storyboard or even a finalfilm.

In the figures of the present description, the avatars of recordedexperiences are differentiated from one another in order to aid in theunderstanding of the subject matter described herein. The avatars mayinstead appear similar to one another so that it is not readily apparentwhich avatars are from a recorded experience and which avatars areparticipating in the current scene. It may, however, be advantageous tovisually or otherwise distinguish avatars participating in a currentscene from avatars in a recorded experience. According to oneembodiment, the avatars of a current scene may be rendered with adifferent degree of shading, different color, different type of clothingor a different theme, for example, than the avatars of a recordedexperience. Alternately, the avatars of a current scene may appear inoutline, or semi- transparent so that they appear as ghosts. Avatars ofa recorded experience may be shown as transparent and may become moreand more transparent to indicate how long ago they visited the scene. Byvisually distinguishing between current users and recorded objects,current users are able to locate one another more easily so that theymay interact with one another. Other methods for distinguishing objectsthat may be interacted with in a currently scene may be provided. Forexample, recorded objects may be ghosted, semi-transparent or haloed.Alternatively, objects of a recorded experience may be in black andwhite while avatars visiting a current scene may be in colour. Avatarsparticipating in a current scene from avatars in a recorded experiencemay be distinguished from one another using audio, may appear the sameand only be distinguished from one another in response to a mouse-overaction by the user. In addition, the audio or visual distinguishingfeature(s) may be toggled on and off in response to a user input.

In another embodiment, a recorded experience may display a timelineselectable to allow a user to jump to a selected time in the recordedexperience, fast forward and rewind. When multiple users are viewing therecorded experience simultaneously, a new instance may be instantiatedwhen playback of the recorded experience is modified by skipping aportion of the recorded experience, for example.

A recorded experience may be modified after it has been recorded.Objects may be deleted, an appearance of objects may be modified or atheme may be added to objects of the recorded experience, for example.The recorded experience may also be shortened or particular timesequences of the recorded experience may be removed.

As the number and type of events that are occurring in virtual worldssystems continues to increase, the desire to record and playbackexperiences will become more significant. The applications for such amethod, system and apparatus are numerous. For example, a prospectivebuyer participating in a virtual house tour may wish to recallsuggestions from a contractor who was present during the tour,participants of a wedding may wish to re-experience the event on theiranniversary or students at a lecture may wish to attend the lecture afurther time in order to refresh their knowledge.

There are several advantages to the method, system and apparatusdescribed herein, some of which may have already been described. Unlikea video recording, which displays a successive series of images, themethod of playing back a recorded experience described herein allows auser to navigate through the recorded experience rather than simplywatch a video playback. In addition, the method of playing back arecorded experience allows for users to interact with other users whoare also participating in the playback of the recorded experience.Another advantage of the method of playing back a recorded experiencedescribed herein is that, unlike video playback, the recorded experienceis not limited by a point of view from which the recording was captured.Because a user is able to navigate through the recorded experience bychanging their position and orientation within the recorded experience,they may view objects from any angle that they choose. As such playbackof the same recorded experience may be different for all users.

The above-described embodiments are intended to be examples only.Alterations, modifications and variations can be effected to theparticular embodiments by those of skill in the art without departingfrom the scope of the present application, which is defined solely bythe claims appended hereto.

1-15. (canceled)
 16. A method comprising: instantiating throughexecution of one or more processors a plurality of instances of a scenein a virtual world, the plurality of instances defined by data frommemory of a server, each of the plurality of instances supportingparticipation of at least one user by way of a client device;automatically assigning a plurality of human-controlled avatars in thevirtual world to the plurality of instances of the scene, each of theplurality of human-controlled avatars corresponding to one of the atleast one users, wherein the assignment of the plurality ofhuman-controlled avatars corresponds to a predetermined number ofhuman-controlled avatars for an event to be performed in each of theplurality of instances; retrieving at least one file corresponding tothe scene from memory, wherein the scene comprises an initial state ofthe scene including at least a position and orientation of one or moreobjects in the virtual world and subsequent changes to the scene duringa time period, the changes to the scene having been generated prior toinstantiation of the plurality of instances; and rendering a newlyinstantiated scene in each of the plurality of instances for display bythe client device of each of the at least one users, wherein: the newlyinstantiated scene comprises the initial state of the scene including atleast the position and orientation of one or more objects in the virtualworld and subsequent changes to the scene during the time period; theplurality of human-controlled avatars may observe the newly instantiatedscene in a respective one of the plurality of instances during a timeperiod in the virtual world corresponding to the time period of thenewly instantiated scene; and the plurality of human-controlled avatarsmay observe at least one object in the respective one of the pluralityof instances.
 17. The method of claim 16, wherein the object is anautomated entity.
 18. The method of claim 16, wherein the newlyinstantiated scene further comprises additional subsequent changes tothe scene generated after the instantiation of the plurality ofinstances.
 19. The method of claim 16, wherein the plurality ofhuman-controlled avatars may interact with the at least one object inthe respective one of the plurality of instances.
 20. The method ofclaim 16, wherein each of the plurality of instances are identical atinstantiation.
 21. The method of claim 16, wherein the subsequentchanges include changes to one or more objects in the virtual world. 22.The method of claim 16, wherein the newly instantiated scene includesaudio and video images.
 23. The method of claim 22, wherein the audioand video images of the newly instantiated scene are a concert.
 24. Themethod of claim 16, wherein the newly instantiated scene is notmodifiable by the plurality of human-controlled avatars.
 25. The methodof claim 16, wherein the newly instantiated scene is not modifiable byobjects in the respective one of the plurality of instances.
 26. Themethod of claim 16, wherein collisions between objects of the newlyinstantiated scene and objects and human-controlled avatars in each ofthe plurality of instances are allowed.
 27. The method of claim 16,wherein collisions between objects of the newly instantiated scene andobjects and human-controlled avatars in each of the plurality ofinstances are not allowed.
 28. The method of claim 27, wherein objectsin the newly instantiated scene may enter into each of the plurality ofinstances.
 29. The method of claim 16, wherein the newly instantiatedscene comprises scripts that effectuate changes in each of the pluralityof instances.
 30. The method of claim 29, wherein the scripts execute inresponse to a user action.
 31. The method of claim 30, wherein thescripts are executed at a particular time during the time period of thescene.
 32. The method of claim 31, wherein the scripts execute inresponse to a trigger event.
 33. The method of claim 16, whereinmovement within each of the plurality of instances are limited by therendering of the newly instantiated scene.
 34. A method comprising:instantiating through execution of one or more processors a plurality ofinstances of a scene in a virtual world, the plurality of instancesdefined by data from memory of a server, each of the plurality ofinstances supporting participation of at least one user by way of aclient device; automatically assigning a plurality of human-controlledavatars in the virtual world to the plurality of instances of the scene,each of the plurality of human-controlled avatars corresponding to oneof the at least one users, wherein the assignment of the plurality ofhuman-controlled avatars corresponds to a predetermined number ofhuman-controlled avatars for an event to be performed in each of theplurality of instances; retrieving at least one file corresponding tothe scene from memory, wherein the scene comprises an initial state ofthe scene including at least a position and orientation of one or moreobjects in the virtual world and subsequent changes to the scene duringa time period, the changes to the scene having been generated prior toinstantiation of the plurality of instances; and rendering a newlyinstantiated scene at a first time of the time period in each of theplurality of instances for display by the client device of each of theat least one users, wherein: the newly instantiated scene comprises theinitial state of the scene including at least the position andorientation of one or more objects in the virtual world and subsequentchanges to the scene during the time period; the plurality ofhuman-controlled avatars may interact with the newly instantiated scenein a respective one of the plurality of instances during a time periodin the virtual world corresponding to the first time period of the newlyinstantiated scene; and the plurality of human-controlled avatars mayinteract with at least one object in the respective one of the pluralityof instances.
 35. The method of claim 34, wherein the object is anautomated entity.
 36. The method of claim 34, wherein the newlyinstantiated scene further comprises additional subsequent changes tothe scene generated after the instantiation of the plurality ofinstances.
 37. The method of claim 34, wherein the plurality ofhuman-controlled avatars may observe the at least one object in therespective one of the plurality of instances.
 38. The method of claim34, wherein each of the plurality of instances are identical atinstantiation.
 39. The method of claim 34, wherein the subsequentchanges include changes to one or more objects in the virtual world. 40.The method of claim 34, wherein the newly instantiated scene includesaudio and video images.
 41. The method of claim 34, wherein the audioand video images of the newly instantiated scene are a concert.
 42. Themethod of claim 34, wherein the newly instantiated scene is notmodifiable by the plurality of human-controlled avatars.
 43. The methodof claim 34, wherein the newly instantiated scene is not modifiable byobjects in the respective one of the plurality of instances.
 44. Themethod of claim 34, wherein collisions between objects of the newlyinstantiated scene and objects and human-controlled avatars in each ofthe plurality of instances are allowed.
 45. The method of claim 34,wherein collisions between objects of the newly instantiated scene andobjects and human-controlled avatars in each of the plurality ofinstances are not allowed.